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Abstract 

General nonconvex optimization problems are studied by using the canonical 
duality theory. The triality theory is proved for sums of exponentials and quartic 
polynomials, which solved an open problem left in 2003. This theory can be 
used to find the global minimum and local extrema. Detailed applications are 
illustrated by several examples. 
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1. Introduction 

In this paper, we intend to solve the following nonconvex optimization prob- 
lem {{V) in short): 

(V) : ext jn(x) = W(x) + ^x'Ax - fx | x € M n | , (1) 

where ext{*} denotes finding extremum points of a function given in {*}, f £ R™ 
is a given (input) vector, A £ R™ xn is a given symmetric matrix, and W : 
W l — s- M is a combination of fourth order polynomials (double-well functions) 
and quadratic-exponential functions, namely: 

W(x) := £ exp Qx'B.x - a t ) + £ | (-x'Cj-x - 6 j 

ielm ^ ' jei P ^ 
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where I m = {l,...,m}, I p = {l,...,p} are two integer sets with m,p are 
fixed integers; all the coefficients bj with j £ / p are positive constants, and 
cti,#j e i Vi £ I m , j £ I p are given parameters; the matrices {Bi}i 6 / m and 
{Cj}jgj are assumed to be symmetric, positive semi-definite such that the cone 
generated by them contains a positive definite matrix. 



The sums of exponential and quartic polynomials W(x) can be used to model 
a large class of nonlinear phenomena in mathematical physics, engineering me- 
chanics, material sciences, network communication, computational biology, and 
much more (see . Due to the nonconvexity of the problem, 

the function II may possess multiple extremal points. To identify both global 
and local extremal values is a main task in global optimization. 

Canonical duality theory and the associated triality for solving general quar- 
tic polynomial optimization problems have been studied recently in [ll|. An 
open problem on the double-min duality statement left by Gao 2003 [f| is solved 
completely. Based on these results, this paper intends to solve the more chal- 
lenging problem (V). We will show that by the canonical dual transformation, 
all critical solutions of (V) can be analytically presented in terms of the canon- 
ical dual solutions. The extremality of these solutions can be identified by the 
triality theory. Several solved examples are listed in the last section. 



2. Canonical Dual Problem and Analytical Solutions 

Following the standard procedure of the canonical dual transformation (cf. 
e.g., Q]), first we need to choose a geometric operator A = (Ai(x), A2(x)) : 
R n -> W m +P, where 

A,(x) = {~x*B,-x o, 1 lr; '"' 

A 2 (x) = [ix'C.x-tf, 
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Therefore, the nonconvex function VF(x) can be written in the following canon- 
ical form 

W(x) = V(A(x)) - Ki(A!(x)) + Va(A 2 (x)) (2) 

with 

Clearly, the canonical function V{e) is convex on 

V a = {e = (e,7) G R" l+P | e, G [-a,, +00), 7, e [-0,-, +00), V« G J m , j G J p } 

(4) 

such that the canonical dual variable s = (t, <t ) of e = (6,7) can be uniquely 
defined by 

s = W(e)=> r = Wi(e) ={exp( ei )}, <r = V^(7) = {^i}, (5) 
and on the canonical dual space 

K = = (t,<t) G M m+P | r, G [exp(-a;),oo), o-j G [-6^,00), Vi G / m , j G J p }, 

(6) 

the Legendre conjugate of V(e) can be defined by 

V c {s) = sta{e*s - V(e)\ eeV a } = Vftr) + V 2 c (<t) (7) 
where sta{*} denotes finding stationary points of the function given in {*} and 

V 1 c (r)= In n-n), V 2 c (<t)=J2^°1 

ieim jei P 3 

By using the canonical dual transformation W(x) — V(A(x)) = A(x) T ^ — V c (s), 
the Gao-Strang total complementary function E : R" x V* — >• M associated with 
the problem (V) can be given by 

S(x,0 = (A(xU)-V^) + ix*Ax-f 4 x 

= ix*G(^)x - «*t - (9V - ^(r) - V 2 » - fx, (8) 

where 

Gt^A+^uBi+H^. (9) 

»€im je-fp 
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Via this H(x, <;), the canonical dual function H d : V* — > M can be defined by 

n d (c) := sta{H(x, ?)| x6 W 1 } = {S(xfc),0 : V x H(x«U) - 0}. 

Notice that V x 2(x, s) = G(<j)x — f = if and only if 

G(t)x = f. (10) 

Let Co/(G(<?)) be the space generated by the columns of the matrix G(s). Then, 
on the dual feasible space 

S a = {<; e V* a : f e Col(G(?))} , 

the primal solution x = (G(<j)) _1 f is well defined (if G(s) is singular, (G(s)) -1 
denotes its pseudo-inverse, see [lj], [2] and references therein) and we have 
U d : S a -> R 

n d W = -ifWf-^M-^l-aV-eV. (ii) 

Therefore, the canonical dual problem is proposed in the following form: 

(T d ): ext{n d (s) : a e S a }. (12) 

By the canonical duality theory, it is not difficult to show that 

n(x) = sta{S(x, t):?£5 a } = S(x, ?(x)), (13) 

where s(x) = (t(x), <x(x)) and 

( T ( x ))« = exp((A 1 (x)) i ), i e J m , 

(o-W)j = 6 J -(A 2 (x)) J -, je/p. 
According to the general theory presented in we have the following result. 

Theorem 1 (Analytical Solutions). Suppose that for a given f G M™ i/ie 
canonical dual space S a is not empty. Ifs G S a is a stationary point ofH d , then 

x=(G(?))- 1 f (14) 
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is a stationary point of II and 



n(x) = n d (^). (is) 

Proof: 

Let us calculate VH%) and V 2 II d (<;). We know that 

v x n d (<o 
^ v CT n d (o 

then 

(V r n d (^)^if t (G(^))- 1 B l (G^))- 1 f-lnr 4 - a ,, i e I m ; (16) 



nm+p 



(Verll^)),- = if t (G(>;))- 1 C J (GW)- 1 f - ^ - ^ .7 G J p . 



v 2 ir%) = 



(17) 



On the other hand, 

v$. T n"(?) v^ir^) 

where V^IT^) := (V T (V cr n d (^)) t ). Let % be the Kronecker's delta. Then 



(V?. T IT , (0)« 



= -f t (G( t ))- 1 B i (G( f ))- 1 B j (G( t ))- 1 f - ^, 



j G An- 

(V^IT^y = -f t (G( ? ))- 1 B i (G(«))- 1 C j (G( ? ))- 1 f 
(V 2 TT n d (^)) ij = -f*(G( t ))- 1 C j (G( t ))- 1 B J .(G(?))- 1 f 

i G ^777, , J G 7p • 

(v^ tr ir , (?))« = -f t (GW)- 1 c i (GW)- 1 c j (G(0)- 1 /-^ 

i, j e /p. 

By making x = (G(s)) _1 f and F(x) e R« x ( m +p) be 
F(x) = [Bix, . . . , B m x, CiX, . . . , C p x], we have 

V 2 n"(?) = -F(x) t (G(>;))- 1 F(x) - Diag f 1, . . . , — , 1, . . . , f) . (18) 



5 



Let D = Diag (ri, . . . , r m , b\, . . . , b p ), then V 2 ±I d (<;) can be written as 

V 2 II d (<0 = -F(x)*(G(^))- 1 F(x) - D 1 . (19) 
Calculating VII (x) and V 2 II(x), we have respectively 



Vn(x) = ex P (^BiX-aA B,x+ b J U X ' C 



jx — 9 -j ) CjX + Ax - f . 

(20) 



V 2 n(x) = A + ex P U X ' B * X ~ ai ) (Bix(B iX )* + Bi) 

+ ]T 6, f C iX (C,x)* + f ix'Cj-x - 6 3 ) C,) . (21) 



jeip v N 7 ' 

Since ^ = (r. <r) is a stationary point of II d then by Equations (fT6|) and (flT]) 
we have that 

(Ai(x))i= In t u i e (22) 
(A 2 (x)) j = |jeV (23) 
Using Equations (|22p and ((2"3"]) in Equation (|2T)|) . we obtain 

Vn(x) = G(?)x - f = G(?)(G(?))- 1 f - f = 0. 

Notice that Equations ((22]) and ((23]) together with Equations (HI]) and ((T3]) 
imply that 

H(x) = S(x,?) = S((G(^))- 1 f,^) = II d (?). (24) 

And this finishes the proof. ■ 
In the next section, we will show that the extremality of some of these 
solutions can be identified by a refined triality theory. 

3. Triality Theory and Perturbation 

Before presenting the refined triality theory, we need the following sets 
5+ := {<;eS a : G(<r) h 0}, 5" := {<; E S a : -< 0}. 



G 



Lemma 1. Suppose that m + p < n, <; £ <S~ is a stationary point and a local 
minimizer ofU d and x = (G(s)) _1 f. Then, there exists a matrixL £ ]R™ x ( m +P) 
loii/i Rank (L) = m + p suc/i that 

L*V 2 n(x)L h 0. (25) 

Proof: Since <? 6 <S~ is a local minimizer of we have that V 2 n rf (<T) y 0. It 
follows from Equation (|T9l) that 



-F(x)*(G(^))- 1 F(x) h D 1 y 0. 

Thus, Rank (F(x)) = m + p. Since s £ S~ and F(x)DF(x)* >; there exists a 
nonsingular matrix T £ M. nxn such that 

T*G(s)T = Diag (— Ai, . . . , — A n ) (26) 

and 

T*F(x)DF(x)*T = Diag (a u . . . , a mi+m2) 0, . . . , 0), (27) 

where Ai > for every i = 1, . . . , n and aj > for every j = 1, . . . , m + p (see 
[3] and references therein). According to Lemma [3] in the Appendix, we 
know that there exists orthogonal matrices U £ R nxn and E £ r(™+p)><(™+p) 
such that 

T*F(x)D^ = URE, (28) 

where Re M" x ( m +P) and 



Ry 



yfal , i = j and ! = l,...,m + p 
0, otherwise. 



According to the singular value decomposition theory, we know that U is the 
identity matrix. Then 

V 2 n d (?) = -F(x) t (G(?))- 1 F(x)-D- 1 

= -(F(x) t T)[T t G(?)T]- 1 (T*F(x)) - D 1 

= -D"5E*R*Diag [-- ) RED ^ - D 1 b 0. 

V Ai A„/ 
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Multiplying by D 2 from the left and the right 

D*V 2 n d (*)D* = -E'R'Diag (- ±-, . . . , -i-) RE - I {m+p)x{m+P ) h 0. 

(29) 

If we multiply the right side of the last equation by E from the left and E* from 
the right, we have 

^ -R*Diag R - I(m+p)x(m+p) 

< Diag ( ^-1,.... 



v Al \m+p 

thus cii > Xi, for every i = 1, . . . , m + p. On the other hand 

T*V 2 n(x)T = T*G(c)T + T*F(x)DF(x)*T 

= Diag (-Ai,...,-A„) +Diag (<n, . . . , a m+p , 0, . . . , 0) 
= Diag (ai — A 1; . . . , a m+p — X m+p , — A m+p+1 , . . . , — A„). 



Let J <E R nxn defined by 



Jij 



1, i = j and i = l,...,m + p 
0, otherwise. 



Then we have 

J'T 4 V 2 n(x)TJ = Diag (ai - Ai , . . . , a m+p - \ m+p ) h 0. (30) 

Let L = TJ, clearly Rank (L) = m + p and L*V 2 II(x)L >; 0, this completes the 
proof. ■ 

In a similar way, we can prove the following lemma. 

Lemma 2. Suppose that m + p > n, <r G S~ is a stationary point U d and x = 
(G(^)) _1 f is a local minimizer ofH. Then, there exists a matrix Q € R( m +p) x ™ 
with Rank (Q) = n such that 

Q t V 2 n d (^)Q h 0. (31) 
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Let the m + p column vectors of L be respectively as li , . . . , l m + P and the 
n column vectors of Q be respectively as qi , . . . , q„ . Clearly, li , . . . , l m + P are 
m + p independent vectors and qi, . . . ,q„ are n independent vectors. Now the 
subspaccs Xb and Sb are defined as follows: 

{m+p 
xel" :x = x+ 5>4., {wjS P C M |> , (32) 




« G R m+P : ? = * + J^q*. {^}"=i Cl[. (33) 

Now we are ready to present the Refined Triality Theory. 

Theorem 2 (Triality Theory). Let ^ be a stationary point of H d and x = 
(G(?))~ 1 f . Assume that dct(V 2 II(x)) ^ 0. 

(i) IfsG <S+, t/ien s is a global maximizer of H d in 5+ and x is a global 
minimizer of II. 

(mJ 7/<t G <S~, i/ien ? is a local maximizer of H d in S~ if and only ifxis a 

local maximizer ofH. 
(Hi) Ifs^S~ and 

a) if n = m + p, then ^ is a local minimizer of U d if and only if x is 
a local minimizer of II, i.e., there exists respectively neighborhoods 
A'.cScR™ ofx andq such that 

H(x) = min H(x) = min II d (0 = H d (?); (34) 
xex <;es 

b) if m + p < n and ^ is a local minimizer of U d , then x is a saddle 
point of II and there exists respectively neighborhoods ^,5 C M" of 
x and such that 

n ^= min n( X )=minn^)=n d (^); (35) 

c) ifn<m + p and x is a local minimizer ofH, then £ is a saddle point 
ofH d and there exists respectively neighborhoods X,S cM. n o/x and 
^ such that 

H(x) = min II(x) = min ir%) = U d (^). (36) 
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Proof: 

(i) Since <; € <S+, from Equation (fT9| it is not difficult to show that IT* is 
strictly concave in Sj and is strictly convex in R™ and therefore ^ must 
be a global maximizer of H d in <S+ and x is a global minimizer of H(-,5). By 
the definition of 3 given in Equation ([8]) and the convexity of V, the Fenchel 
inequality leads to 

S(x,0<n(x), V(x,«) el" x5 a . 

Let us assume now that there exists a vector x' € R™ such that II(x') < n(x), 
then 

n(x) > n(x') > a(x',?) > s(x,?) = n(x), 

where the last equality comes from Equation (1241) . This contradiction proves 
that x must be a global minimizer of II. 

(ii) Notice first that using Equations ([22]) and (|23[) in Equation (|2~Tj) we have 

V 2 II(x) = G(t) + F(x)DF(x)*, (37) 

where F(x) and -D are defined in Equation (fT"9"|) . If ^ is a local maximizer of II d 
in S~ we must have that V 2 IT d (<;) ^ 0, from Equation (fl"9)) this is equivalent to 

D 1 + F(x) t (G(?))^ 1 F(x) h 0. (38) 

• If m + p = n and F is invertible, multiplying Equation (|3"5)) by (F(x)') -1 
from the left and (F(x)) -1 from the right, we have: 

(F(x) t )- 1 D- 1 (F(x))- 1 + (G(^))- 1 t (39) 

this is equivalent to 

(F(x) t )- 1 D- 1 (F(x))- 1 h -(G(?))" V 0, 

which in turn is equivalent to (Lemma [4] in the Appendix) 

-G(?) >: F(x)DF(x)< V 2 n(x) r< 0. 

By assumption det(V 2 IT(x)) 7^ 0, then x is a local maximum of IT. 
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• If m +p n or F is not invertible, then by Lemma [31 there exists orthog- 
onal matrices E e R nXn , K e R( m +P) x and a matrix R € M«x(™+p) 
such that 

Si, i = j and i = 1, . . . , r 
0, otherwise 
where s, > for every i, r = Rank (F(x)) and 

F(x)D5 = ERK. (40) 

Using Equation (|40|) . Equation (|38|) can be rewritten as: 

D 1 + D-^K*R t E t (G(^))- 1 ERKD-5 t 

after multiplying this equation by KD^ from the left and D^K* from the 
right, we have 

I(m+p) x (m+p) + R*(E*G(^)E) _1 R y 0. 
This equation is equivalent to 

-I(m+p)x(m+p) _ R t (E t G(?)E)~ 1 R ^ 0. 
By Lemma [5] in the Appendix, the last equation is equivalent to 

t E*G(?)E + RR* = E*G(?)E + R(KD ^DD ^K'jR* 
multiplying by E from the left and E* from the right 
y G(?)+(ERKXH)D(D-3K*R*E*) = G(?)+F(x)DF(x)* = V 2 n(x). 
By the assumption det(V 2 n(a;)) ^ 0, x is a local maximum of LI. 

Notice that every step of the proof are equivalent, so if x is a local maximum of 
II then ^ must be a local maximum of H d . 
(iii) Let us consider the three cases: 



11 



a) n = m + p: if ^ is a local minimizer of H d then 

V 2 n d (^) = -F(x)*(G(^))- 1 F(x) - D- 1 t 

«=► -F(x) t (G(^))- 1 F(x) h D 1 . 

This implies that Rank (F(x)) = n. By multiplying the last inequality by 
(F(x)*) -1 from the left and by (F(x)) -1 from the right, we have 

-(G(^))- 1 y (F(x) t )- 1 D- 1 (F(x))- 1 . 

By Lemma 0] this is equivalent to 

-G(?) d F(x)DF(x)< V 2 II(x) ^ 0. 

And since det(V 2 II(x)) ^ 0, x is a local minimizer of II. In a similar way 
we can prove the converse. 

b) From Equation p^|) we know that 

-F(x) t (G(^))- 1 F(x)bD- 1 , 

then — F(3c)*(G(?)) -1 F(x) is a nonsingular matrix and Rank (F(x)) = 
m + p < n. We claim now that x is not a local minimizer of EL This is 
because that if x is also a local minimizer, we would have 

V 2 II(x) = G(?) + F(x)DF(x) 4 h 0, 

thus 

F(x)DF(x)* h -G(?). 

This implies that 

n = Rank (-G(s)) = Rank (F(x)DF(f)') = m + p, 
which is a contradiction. Therefore, x is a saddle point of EL 

To prove Equation (|35|) . we let L be as in Lemma Q] and {L}™^ p be the 
column vectors of L. Define 

<p(ti, . . . , t m+p ) :— II(x + till + . . . + t m +pl m +p). 
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We need to show that (0, . . . , 0) G R m+P is a local minimizer of the function 
ip. Notice that 

v</j(o,...,o) = L t vn(x) = o 

and 

V 2 </j(0, . . . , 0) = L'V 2 n(x)L h 0, 

which is a consequence of Lemma [T] Furthermore, from Equation (|30p we 
have that 

VV(0, . . . , 0) = Diag (oi - Ai, . . . , a m+p - A m+P ), 

and since det(V 2 II(x)) ^ it can be proven that a, > A^ for every i. The 
proof is complete. 

c) The proof is similar to item b). ■ 

Remark: The triality theory states precisely that if s is a global maximizer 
of TT d on a certain set, then x is a global minimizer for IT. This is known from the 
general result by Gao and Strang in [10j . If s is a local maximizer for IT d then x is 
also a local maximizer for II. This is the so-called double-max duality statement. 
If ^ is a local minimizer for TT rf , then x is also a local minimizer for II in certain 
directions. This is so-called double-min duality in the standard triality form 



jroposed in [4] . The triality theory was first discovered in nonconvex mechanics 
3j. It was realized in 2003 that the double-min duality holds under certain 
additional condition, which was left as an open problem (see 0,3). Recently, 
this open problem is solved for quartic polynomial optimization problem 11] . 
This result is now generalized to the general nonconvex problem (V). Part (iii) 
of Theorem [2] shows that if m + p = n, then s is a local minimizer if and only 
if x is also a local minimizer. In other cases either x is a saddle point of IT or <; 
is a saddle point of IT d . 

4. Numerical Examples 

In the following examples, m — p = 1 and b\ = 1. The graphs provided and 
the numerical results were obtained using Maxima [l^ |. 
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(a) Contour Levels of IT. (b) Graph of IT. 

Figure 1 : II function of Example 1 

Example 1: Unique solution 

First, we consider the case that the primal function has a unique critical 
point. We let ai = Q\ = 1 and 





1 




1 




1 




1 


A = 




Bi = 




,c 1 = 




,f = 






-1 


2 


1 


1 



Clearly, the function II : R 2 — > R is given by 

IL(x, y) = exp Q(x 2 + 2y 2 ) - lj + l - Q(x 2 + y 2 ) - l) + l -{x 2 - y 2 ) - x - y, 

and the dual function has the form of 

n d (r. <t) = --( + ^ - t ■ ln(r) - -a 2 - a. 

y ' ' 2\1 + t + o- 2t + <t-1) w 2 

It can be shown that H d has only one critical point in <S+ and it is given 
(approximately) by 

? = (1.171057661103504, -0.34599084656216). 

By the triality theory, the vector 

x = G(?) _1 f = (0.54792514555217, 1.003890602479819) 

is a global minimizer of the primal problem. 
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(a) Contour Levels of IT*, (b) Graph of Yl d . 

Figure 2: LT d function of Example 1 

4-2. Example 2: Two solutions 

We now consider the case that the primal function has two critical points. 
Let ol\ = 1, 9i = 50, and 





1 




1 




1 




-25 


A = 


-16 


,Bi = 


1 


,Ci = 


2 


,f = 


9 



The primal function IT : IR 2 
1 



is then given by 
1 fl 



U(x,y) = exp ^-(x 2 + y 2 ) - i^-(x 2 + 2y 2 ) - 50j +-(x 2 -16y 2 )+25x~9y 

and its canonical dual is 

1 [ 81 



n d (r,a) = 



625 \ , , , 1 2 

1 r • n t - -a 2 - 50cr, 

16 + r + 2cr l + T + o-J K ' 2 



which has two critical points: 

?I = (96.61711963278241, -38.94928057661689) € <S+, 

5? = (0.42157060067968, -49.86072154366873) G 5~. 
Therefore, by the triality theory, the associated vector 

xT = G(5T) -1 f = (-0.42612784793499, 3.310578038951848) 

is a global minimizer of Il(x) and 

5c^ = (0.51611144112381, -0.078057328303129) 

is a local maximizer (see Figure [3]) since ft is a local maximum of IT d in S~ (see 
Figure El). 
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(a) Contour Levels of IT. (b) Graph of IT. 

Figure 3: Primal function LT in Example 2 




(a) Contour Levels of n d in S+. (b) Graph of Tl d in 

Figure 4: H d function in of Example 2 





(a) Contour Levels of Tl d in S a . (b) Graph of Il d in 

Figure 5: H d function in S~ of Example 2 



1G 



(a) Contour Levels of IT. (b) Graph of II. 

Figure 6: II function of Example 3 

4-3. Example 3: Multi-solutions 

In order to illustrate the triality theory, we let a± = 6\ = 2, and 





-16 




1 









2 


A = 




,B 1 = 




,Ci = 




,f = 






-4 







1 


2 



Accordingly, we have 

H(x, y) = exp Qx 2 - 2^ + X - Qy 2 - 2^ + ^(-16x 2 - 4y 2 ) -2x- 2y, 

n d (r,a) =--( — ^— + ——) - t • ln(r) - r - -a 2 - 2a. 
In this case, II d has total six critical points but only one 

5T = (16.64468576727409,4.552474610531074) G «S+, 

(see Figure [7]) and two 

55 = (0.13641513779858, -1.943380912562619) G 5", 

55= (15.34981976568548,3.390906302031545) G 5~. 

From Figures[8]we can see that 55 is a local maximizer and 55 is a local minimizer 
of H d . Therefore, by the triality theory, we know that 

xT= G(5i) _1 f = (3.102286573591542,3.620075858467906) 

is a global minimizer; 

x5 = (-0.12607490787063, -0.33650880356205) 
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(a) Contour Levels of II d in <S+. (b) Graph of n d in <S+. 

Figure 7: H d function in 6> + of Example 3 




(a) Contour Levels of H d in S a ■ (b) Graph of H d in Oo, • 

Figure 8: H d function in S~ of Example 3 

is a local maximizer and 

xi = (-3.076070133243102, -3.283567054905852) 

is a local minimizer of n(x) (see Figure [S]). 
4-4- Example 4- Non-unique global minima 

In the case that 5+ is empty, the primal problem could have more than one 
global minima. To see this, we let f = 0, a\ = 9\ = 2, and 

A = 0,Bi = 

In this case, the primal function 

U(x,y) =expQx 2 -2^) +1 Qy 2 

has 2 global minimums at (0,-2), (0,2) and a local maximum at (0,0). While 
the dual function 



1 

















,Ci = 

















1 



U d (r,a) = -rhxT-r - ^a 2 - 2a 
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does not have a stationary point in <S+. Indeed, its only critical point is in the 
boundary of its domain: ^ = (exp(— 2), —2). By defining x = G(s) _1 f, we have 
that x= (0,0). 

In order to find a global minimum of II, we need to introduce the following 
perturbations: 











and f„ 



, for every n € IV. 



Then, the associated primal and dual functions are 

2 



U n (x,y) = cxp 



1 



-X 



1 

2 V 2 



16 2 4 2 
— x 3/ 

n n 



2 2 

-a — y, 

n n 



1 / 4 4 \ 1 2 „ 

9 "57 i6Y + ^7 4T ] -tIut + t- -a -It -2a. 



Notice that if n = 1 we are in the case presented in Example 3. Let us show that 
for sufficiently large values of n we can find a stationary point for LT^ in <S+, 
namely Furthermore, by defining x„ = G(^„) _1 f n we will have a convergent 
sequence. 

Let us calculate the gradient of 11^ : 



vn£(r,a) = 



-2 - lnr + 7 — ^tt^t 

(nr — 16)^ 



-cr - 2 + 



(ncr-4) 2 

2 w and g(cr) = — a — 2 + 



t — . It is not difficult 



Let h(r) = -2-lnr-r (nT _ 16) 
to show that there exists a sufficiently large N £ IN, such that if n > N, the 
following are true: 

a) n ■ exp (— 2 + — J — 16 and n ■ cxp (—2) — 16 are positive numbers. 



b) h exp -2 



< < ft(exp(-2)) = 



(n • exp(-2 + I) - 16) 2 
2 



(n-exp(-2) - 16) 2 ' 



c) 9 



5A 

n 



5.1 



0.34710743801 < < g 

n 



4.9 

n 



0.46913580247- 



4.9 
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Based on these results, we know that for every n > N, VII„ has a stationary 
point y = (T n ,W n ) € [exp(-2),exp(-2+i)] x ^] . Moreover, by the fact 
that g(cT n ) — 0, it is easy to obtain lim n ■ a n = 5. 

n— »+oc 







Notice also that 

G(? n ) = 

is positive definite. Therefore, the perturbed solution can be obtained as 



16 

n 



a n - ± 



X„ = G(Sn) X = 



n-r ?l — 16 
2 



Since r„ € [exp(— 2), exp(— 2 + -)} then lim r„ = exp(— 2). By the fact that 
lim n ■ a n — 5, we have 

n— >+oo 



lim x„ 



which is a solution of n. 

Canonical perturbation method was originally introduce in \\\ for solving 
nonconvex polynomial minimization problems. This method has been used suc- 
cessfully in integer programming and network communication (see j^i fli^). 

5. Appendix: Some Lemmas in Matrix Analysis 

The following results are needed in the proofs of Section 2. 

Lemma 3. (Singular value decomposition llA l) For any given matrix M C 
R mxn with Rank (M) = r, there exists U C K mxm , R C W nxn and E C W ixn 
such that 

M = URE; 

where U and E are orthogonal matrices, and 

J si, i=j,i = l,...,r 
Hij - < 

{ 0, i^j, 
where Sj > for every i = 1, . . . , r. 
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Lemma 4. IfG and U are positive definite matrices in W ixn , then G > U 
if and only i/U -1 y G . 



Lemma 5. fli l Suppose P, U and D are f/iree matrices in W ixn such that 



D 







m x (n — m) 



0(n— rn)xn 0(n — m)x(n — m) 



where Dn G ]R mxm 
P = 



is nonsingular and 



Pll Pl2 
P21 P22 



^ 0, u = 



Un o mx 



(71— m) 







(n— m) x m 



u 
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^0, 



Pij and XJa are appropriate dimensional matrices for i,j — 1,2. Then, 



P + DUD* r< -D^^D U 1 ^ 0. 



(41) 
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